Training and experience of coding with the World Health Organization's International Classification of Diseases, Eleventh Revision.

BACKGROUND: The new International Classification of Diseases, Eleventh Revision for Mortality and Morbidity Statistics (ICD-11) was developed and released by the World Health Organization (WHO) in June 2018. Because ICD-11 incorporates new codes and features, training materials for coding with ICD-11 are urgently needed prior to its implementation. OBJECTIVE: This study outlines the development of ICD-11 training materials, training processes and experiences of clinical coders while learning to code using ICD-11. METHOD: Six certified clinical coders were recruited to code inpatient charts using ICD-11. Training materials were developed with input from experts from the Canadian Institute for Health Information and the WHO, and the clinical coders were trained to use the new classification. Monthly team meetings were conducted to enable discussions on coding issues and to select the correct ICD-11 codes. The training experience was evaluated using qualitative interviews, a questionnaire and a coding quiz. RESULTS: total of 3011 charts were coded using ICD-11. In general, clinical coders provided positive feedback regarding the training program. The average score for the coding quiz (multiple choice, True/False) was 84%, suggesting that the training program was effective. Feedback from the coders enabled the ICD-11 code content, electronic tooling and terminologies to be updated. CONCLUSION: This study provides a detailed account of the processes involved with training clinical coders to use ICD-11. Important findings from the interviews were reported at the annual WHO conferences, and these findings helped improve the ICD-11 browser and reference guide.

Coding reliability and agreement of International Classification of Disease, 10th revision (ICD-10) codes in emergency department data.

INTRODUCTION: Administrative health data from emergency departments play important roles in understanding health needs of the public and reasons for health care resource use. International Classification of Disease (ICD) diagnostic codes have been widely used to code reasons of clinical encounters for administrative purposes in emergency departments. OBJECTIVE: The purpose of the study is to examine the coding agreement and reliability of ICD diagnosis codes in emergency department records through auditing the routinely collected data. METHODS: We randomly sampled 1 percent of records (n=1636) between October and December 2013 from 11 emergency departments in Alberta, Canada. Auditors were employed to review the same chart and independently assign main diagnosis codes. We assessed coding agreement and reliability through comparison of codes assigned by auditors and hospital coders using proportion of agreement and Cohen's kappa. Error analysis was conducted to review diagnosis codes with disagreement and categorized them into six groups. RESULTS: Overall, the agreement was 86.5% and 82.2% at 3 and 4 digits levels respectively, and reliability was 0.86 and 0.82 respectively. Variations of agreement and reliability were identified across different emergency departments. The major two categories of coding discrepancy were the use of different codes for same condition (23.6%) and the use of codes at different levels of specificity (20.9%). CONCLUSIONS: Diagnosis codes in emergency departments show high agreement and reliability, although there are variations of coding quality across different hospitals. Stricter coding guidelines regarding the use of unspecified codes are needed to enhance coding consistency.